| Provider | Model | |
|---|---|---|
| 1 | anthropic | claude-3-5-sonnet-20241022 |
| 2 | anthropic | claude-3-7-sonnet-20250219 |
| 3 | gemini-2.5-flash | |
| 4 | xai | grok-3-beta |
Building on our previous analysis, we selected only top models.
| case | survey | N | topic | subtopic | |
|---|---|---|---|---|---|
| 1 | UBC Bio | biobanking_mayo_ubc | 17 | genomics | genomics |
| 2 | CCPS ACT Deliberative | ccps | 31 | climate | climate |
| 3 | CSIRO WA | energy_futures | 17 | climate | energy |
| 4 | FNQCJ | fnqcj | 11 | climate | transportation |
| 5 | Forest Lay Citizen | forestera | 9 | climate | forest |
| 6 | Fremantle | fremantle | 41 | transportation | transportation |
| 7 | Activate | uppsala_speaks | 26 | immigration | immigration |
| 8 | Standard | uppsala_speaks | 22 | immigration | immigration |
| 9 | Winterthur | zh_winterthur | 16 | climate | climate |
Also building on our previous analysis, we selected only deliberative cases.
| survey | considerations | policies | scale_max | q_method | |
|---|---|---|---|---|---|
| 1 | biobanking_mayo_ubc | 38 | 7 | 11 | FALSE |
| 2 | ccps | 33 | 7 | 11 | FALSE |
| 3 | energy_futures | 45 | 9 | 11 | FALSE |
| 4 | fnqcj | 42 | 5 | 12 | FALSE |
| 5 | forestera | 45 | 7 | 11 | FALSE |
| 6 | fremantle | 36 | 6 | 11 | TRUE |
| 7 | uppsala_speaks | 42 | 7 | 7 | FALSE |
| 8 | zh_winterthur | 30 | 6 | 7 | FALSE |
Note that two of the cases share the same survey.
| type | n |
|---|---|
| devils | 1 |
| ideology | 10 |
| perspective | 10 |
| uid | type | role | description | |
|---|---|---|---|---|
| 1 | csk | devils | climate skeptic | prioritizes economic growth over CO2 emission cuts, fossil fuels over renewable energy, and does not believe in climate science |
| 2 | ana | ideology | anarchist | rejects all coercive authority and hierarchical government, advocating stateless, voluntary societies |
| 3 | con | ideology | conservative | seeks to preserve traditional institutions, customs, and values, favoring order and gradual change |
| 4 | eco | ideology | ecologist | focuses on environmental protection and sustainability, advocating for societal change to ecological limits |
| 5 | fas | ideology | fascist | promotes extreme nationalism, authoritarianism, militarism, and a totalitarian state |
| 6 | fem | ideology | feminist | advocates for gender equality, challenging patriarchal structures and discrimination against women |
| 7 | fun | ideology | fundamentalist | adheres strictly to core beliefs, often religious, applying these principles to all life aspects |
| 8 | lib | ideology | liberal | advocates individual liberty, rights, limited government, and free markets, emphasizing individual autonomy |
| 9 | nat | ideology | nationalist | prioritizes the interests and identity of a particular nation, often seeking self-determination |
| 10 | pop | ideology | populist | appeals directly to “the people” against a perceived corrupt elite using anti-establishment rhetoric |
| 11 | soc | ideology | socialist | aims for social ownership or control of production, emphasizing equality and collective welfare |
| 12 | coa | perspective | coastal resident | endures chronic flooding and salinization, forced to relocate due to rising sea levels and intense storms worsened by climate change |
| 13 | ctr | perspective | construction worker | suffers from extreme heat stress and lost work hours, perceiving climate change making outdoor labor unbearable and life-threatening |
| 14 | dis | perspective | disease survivor | recovers from dengue fever, aware that climate change’s rising temperatures are expanding the range of disease-carrying mosquitoes in their region |
| 15 | eld | perspective | elderly urban resident | endures intensified city heatwaves, struggling with disrupted services and feeling the direct, severe impact of climate change |
| 16 | far | perspective | displaced family | loses their home due to unprecedented wildfires, experiencing displacement and recognizing climate change as the major driver of the devastation |
| 17 | fis | perspective | fisher | notes his declining catches due to warming oceans, understanding that climate change is reorganizing marine life and reducing their traditional yield |
| 18 | lan | perspective | landowner | surveys his parched fields after a prolonged drought, feeling the compounding impacts of climate change that reduce crop yields and family income |
| 19 | par | perspective | parent | sees their child fall ill from a water-borne disease, attributing its spread to the increased heavy rainfall and warmer temperatures brought by climate change |
| 20 | sub | perspective | subsistence farmer | watches his crops wither under erratic rainfall patterns, and who sees these changes as direct consequence of climate change |
| 21 | vil | perspective | villager | faces dwindling, contaminated water supplies due to extended draughts and floods, aware that climate change is altering their water security |
We collected a total of 3360 LLM responses from 4 models across 8 surveys and 21 roles. We prompted each LLM 5 times with the same prompt.
| case | survey | N | topic | subtopic | |
|---|---|---|---|---|---|
| 1 | CCPS ACT Deliberative | ccps | 31 | climate | climate |
| 2 | CSIRO WA | energy_futures | 17 | climate | energy |
| 3 | FNQCJ | fnqcj | 11 | climate | transportation |
| 4 | Forest Lay Citizen | forestera | 9 | climate | forest |
| 5 | Winterthur | zh_winterthur | 16 | climate | climate |
| uid | type | article | role | description | |
|---|---|---|---|---|---|
| 1 | eco | ideology | an | ecologist | focuses on environmental protection and sustainability, advocating for societal change to ecological limits |
| 2 | coa | perspective | a | coastal resident | endures chronic flooding and salinization, forced to relocate due to rising sea levels and intense storms worsened by climate change |
| 3 | ctr | perspective | a | construction worker | suffers from extreme heat stress and lost work hours, perceiving climate change making outdoor labor unbearable and life-threatening |
| 4 | dis | perspective | a | disease survivor | recovers from dengue fever, aware that climate change’s rising temperatures are expanding the range of disease-carrying mosquitoes in their region |
| 5 | eld | perspective | an | elderly urban resident | endures intensified city heatwaves, struggling with disrupted services and feeling the direct, severe impact of climate change |
| 6 | far | perspective | a | displaced family | loses their home due to unprecedented wildfires, experiencing displacement and recognizing climate change as the major driver of the devastation |
| 7 | fis | perspective | a | fisher | notes his declining catches due to warming oceans, understanding that climate change is reorganizing marine life and reducing their traditional yield |
| 8 | lan | perspective | a | landowner | surveys his parched fields after a prolonged drought, feeling the compounding impacts of climate change that reduce crop yields and family income |
| 9 | par | perspective | a | parent | sees their child fall ill from a water-borne disease, attributing its spread to the increased heavy rainfall and warmer temperatures brought by climate change |
| 10 | sub | perspective | a | subsistence farmer | watches his crops wither under erratic rainfall patterns, and who sees these changes as direct consequence of climate change |
| 11 | vil | perspective | a | villager | faces dwindling, contaminated water supplies due to extended draughts and floods, aware that climate change is altering their water security |
| 12 | csk | devils | a | climate skeptic | prioritizes economic growth over CO2 emission cuts, fossil fuels over renewable energy, and does not believe in climate science |